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OO ' SUMMARY 

<N ' 

The small gain condition is sufficient for input-to-state stability (ISS) of interconnected systems. However, 
verification of the small gain condition requires large amount of computations in the case of a large size of 
the system. To facilitate this procedure we aggregate the subsystems and the gains between the subsystems 
that belong to certain interconnection patterns (motifs) using three heuristic rules. These rules are based on 
three motifs: sequentially connected nodes, nodes connected in parallel and almost disconnected subgraphs. 
Aggregation of these motifs keeps the main structure of the mutual influences between the subsystems in the 
network. Furthermore, fulfillment of the reduced small gain condition implies ISS of the large network. Thus 
such reduction allows to decrease the number of computations needed to verify the small gain condition. 
Finally, an ISS-Lyapunov function for the large network can be constructed using the reduced small gain 
condition. Applications of these rules is illustrated on an example. Copyright © 2010 John Wiley & Sons, 
\0 ! Ltd. 
OV 
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1. INTRODUCTION 

X: 

Starting with the pioneering works [20], [19] interconnection of input-to-state stable (ISS) systems 
has been studied by many authors, see for example [27], [2], [10], [16]. In particular, it is known that 
cascades of ISS systems are ISS, while a feedback interconnection of two ISS systems is in general 
unstable. The first result of the small gain type was proved in [20] for a feedback interconnection of 
two ISS systems. The Lyapunov version of this result is given in [19]. These results were generalized 
for an interconnection of n > 2 systems in [12], [11], [21] and [23]. In particular, they state that if 
the so-called small gain condition T(s) ^ s holds, then interconnection of ISS systems is ISS. Here 
the gain matrix T describes an interconnection structure of the system. For recent results on the 
small gain conditions for a wider class of interconnections we refer to [21], [17] and [23]. In [18] 
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the authors consider necessary and sufficient small gain conditions for interconnections of two ISS 
systems in dissipative form. 

Verification of the small gain condition T(s) ^ s requires large amount of analytical computations 
in the case of the large size interconnected system. This procedure can be facilitated by reducing 
the size of the system, by applying a numerical method or applying a method that reduces the size 
of the gain matrix T . 

Model reduction of linear large-scale systems is already a well-developed area. The most 
efficient approaches are balancing and moment matching (Krylov subspace methods), see [3]. In 
balancing methods state variables that are hard to control/observe are eliminated from the model. An 
approximation norm is usually given in terms of "Hoo- or T^-norms. In moment matching methods 
a function that matches certain moment of the Laurent series expansion is being looked for. These 
methods are computationally efficient in comparison with balancing methods, however provide no 
approximation error bounds. Usually, one uses a combination of both methods where first the large 
size is reduced by the moment matching methods and then the balancing method is applied. 

On the contrary, the methods for the reduction of nonlinear systems are still in the development. 
As of today, there exist many different approaches that provide first steps in the direction of the 
reduction of nonlinear systems. However, these approaches are applied only to certain subclasses 
of nonlinear systems. The most known methods are an extension of the balancing and moment 
matching methods to nonlinear systems, proper orthogonal decomposition, singular perturbations 
theory, trajectory piecewise linear approach, Volterra methods and the theory of global attractors. 
The balancing methods [35], [29] are applied to input-affine continuous-time nonlinear systems, 
and the moment matching to single-input single-output systems [4] and bilinear systems [9]. In 
the proper orthogonal decomposition (POD) [14], [5], [15] the original system is projected onto a 
subspace of a smaller dimension using the known set of data (snapshots). POD methods are usually 
applied to models describing physical systems. Singular perturbations theory [8], [25] is used 
for the systems, where parameters evolve in different time scales ("slow" and "fast" parameters). 
This approach assumes aggregation of the variables evolving in the fast time scale. The trajectory 
piecewise linear approach [32] is mostly applied to input-affine systems. The system is linearized 
several times along a trajectory and the final model is constructed as a weighted sum of all local 
linearized reduced systems. In Volterra methods [31] the reduction is performed by taking into 
account the first several terms of the Polynomial expansion of a nonlinear function. In the theory 
of global attractors [24] one searches for a slow-manifold, inertial manifold or center manifold, on 
which a restricted dynamical system represents the "interesting" behaviour of the dynamical system. 

Note that, if these methods will be directly applied to an application network, then information 
about the real physical objects of a network and of its structure will be, in general, lost. Therefore, 
a reduction method that preserves the main structure of the network is needed. 

Structure preserving model reduction was studied in [36], [28], [34]. However, it is also applied 
only for particular classes of systems. 

Another possibility to decrease the number of analytical computations in verifying the small gain 
condition is an application of numerical methods [33], [13]. There is considered a local version of 
ISS. 

On the other hand, to the best of our knowledge, there exist no approaches for the reduction of 
the size of the gain matrix T in the small gain condition. In this paper we make the first attempt 
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in this direction. On the other hand, to the best of our knowledge, there exist no approaches for 
the reduction of the size of the gain matrix T in the small gain condition. In this paper we make 
the first attempt in this direction. By the reduction we understand a reduction of the gain matrix, 
i.e. transition from the gain matrix T of size n to the matrix T of size k < n. To obtain the matrix 
L we propose to aggregate the subsystems and the gains between the subsystems that belong to 
certain interconnection patterns, so-called motifs [30]. Aggregation of these motifs keeps the main 
structure of the mutual influences between the subsystems in the network. Thus the properties of the 
aggregated and the original models should be similar. This prompts us that ISS of the large-scale 
network can be established by checking the aggregated small gain condition corresponding to the 
smaller gain matrix T. 

In this paper we introduce three aggregation rules for the reduction of the gain matrix. These 
rules are based on three motifs: sequentially connected nodes, nodes connected in parallel and 
almost disconnected subgraphs. We establish that fulfillment of the reduced small gain condition 
implies ISS of the large network. Furthermore, we show how an ISS-Lyapunov function for the 
large network can be constructed using the so-called fi-path corresponding to the reduced small 
gain condition. 

In Section 2 we introduce all necessary notation and recall the small gain condition. Then in 
Section 3 we show how the size of this condition can be reduced. This is illustrated on the example 
in Section 4. Conclusions are given in Section 5. 



2. NOTATION 



2.1. Vectors and spaces 

In the following we set R + := [0, oo) and denote the positive orthant R2. := [0, oo) n . The transpose 
of a vector x G R n is denoted by x T . On K™ we use the standard partial order induced by the positive 
orthant given by 

x > y <^=> Xi > yi, i=l,...,n, 
x>y^=^Xi>yi, i=l,...,n. 



We write x 2; y <= 
For a function v 



3i G {1, . . . , n} : x t < y t . 

i + —> R m we define its restriction to the interval [si, s 2 ] by 



](*) = 



v(t), if t G [si,s 2 ], 
0, otherwise. 



A continuous function a 



i + —> K_|_, where a(r) —Q if and only if r — 0, is called positive 
R + is said to be of class /C if it is continuous, strictly increasing and 



definite. A function 7 : K + — > 
7(0) = 0. It is of class /Coo if, in addition, it is unbounded. Note that for any a G /Coo its inverse 
function a -1 always exists and a~ x G K,^. A function /3 : R + x K + — > R + is said to be of class 
ICC if, for each fixed t, the function /3(- , t) is of class K. and, for each fixed s, the function 1 1-> P(s,t) 
is non-increasing and tends to zero for t — > 00. By id we denote the identity map. 
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Let I • I denote some norm in R n . The essential supremum norm of a measurable function 
</> : R + — >• W n is denoted by H^H^. £00 is the set of measurable functions for which this norm 
is finite. 



2.2. Graphs 

We introduce also the notion of graphs from [6] and show how graphs can be described by matrices. 
A directed graph with weights consists of a finite vertex set V and an edge set £, where a directed 
edge from vertex i to vertex j is an ordered pair (i, j) e £ c V x V. The weights can be represented 
by a | V| x |V| weighted adjacency matrix A, where a t j > denotes the weight of the directed edge 
from vertex i to vertex j. By convention > 0, if and only if (i, j) e £ . We will denote a directed 
graph with weights of this form by G — (V, £, A). Additionally, we define for each vertex i the set 
of successors by 

S(i):={j : {i,j)e£} (1) 

and the set of predecessors by 

P(i) := {j : e £}. (2) 

A path from vertex i to j is a sequence of distinct vertices starting with i and ending with j such 
that there is a directed edge between consecutive vertices. A directed graph is said to be strongly 
connected, if for any ordered pair (i, j) of vertices, there is a path which leads from i to j. In terms 
of the weighted adjacency matrix this is equivalent to the fact that A is irreducible, [7]. 



2.3. Interconnected dynamical systems and input-to-state stability 

In this paper we study continuous dynamical systems. We consider a system 

x = f(x,u), xeR n , «eM m , (3) 

and assume it is forward complete, i.e., for all initial values x(0) S M. n and all essentially bounded 
measurable inputs u solutions x{t) — x(t; x(0),u) exist for all positive times. Assume also that for 
any initial value a;(0) and input u the solution is unique. 

We are interested in input-to-state stability (ISS) of systems of the form (3). We define ISS as 
follows, see [40]. 

Definition 2.1 (Input-to-state stability) 

System of the form (3) is called input-to-state stable (ISS), if there exist functions /3 e ICC and 
j£K, such that for all x(0) &R n ,u£ L 00 (R+,R m ) 

\x(t)\ <max{/3(|x(0)|,0,7(IML)}> t > 0. (4) 
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We assume that there are n interconnected dynamical systems given by 

±1 = /i(xi,...,a;„,ui) 

; (5) 

&n — fn \X\ : • • • j ; ^n) 

where Xi £ R Ni , 14 £ R mi and the functions fa : E^ =1 N i +m * -> R N * are continuous and for all 
re Mare locally Lipschitz continuous in x = (xi T , . . . , x n T ) T uniformly in m for \m\ < r. This 
regularity condition for fa guarantees the existence and uniqueness of solution for the ith subsystem 
for a given initial condition and input Uj. 

The interconnection (5) can be written as (3) with x := (xf, . . . , x^) T , 
u := (uf, . . . ,u^) T and 

f(x, u) = (fi(xi, . . . , x n , ui) T , . . . , f n (xi, ■ ■ ■ ,x n , u n ) T ) T . 

If we consider the individual subsystems, we treat the state Xj , j ^ i as an independent input for the 
ith subsystem. 

The ith subsystem of (5) is ISS, if there exist functions of class K.C, jy, j( £ K.^ U {0} such 
that for all initial values Xi(0) and inputs u £ Loo(]R + ,R m ) there exists a unique solution Xi(-) 
satisfying for alH > 

|x l (t)|<max{/3 l (|a; i (0)|,t),max{7y(||a; i[0:t] || oo )},7. i (||u|| oo )} (6) 

Another notion useful for stability investigations of nonlinear systems is the notion of an ISS- 
Lyapunov function. 

Definition 2.2 (ISS-Lyapunov function) 

Continuous function V : E" — > R+ is called an ISS Lyapunov function for E, if it is locally 
Lipschitz continuous on M™\{0} and 

• 3ipi , -02 £ K-oo such that 

MM) < V(x) < ^a(||aj||), Vx £ W\ 

• 3j £ K, and positive definite function a such that in all points of differentiability of V 

V{x) > 7 (||«||) => VV(x)f(x,u) < -a(\\x\\). 

Remark 2.3 

In Theorem 2.3 in [11] it was proved that the system (3) is ISS if and only if it admits an (not 
necessarily smooth) ISS Lyapunov function. 

A locally Lipschitz continuous function Vi : M.^ — > K + is an ISS Lyapunov function for (5), if: 
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• 37-yG/Coo U {0}, j^i, 3ji£JC: in all points of dif. of Vi 

Vi(xi) > max{max7ij-(V5(xj)),7i(||tt||)} => VK(ii)/,(i,«) < -a,-(||:E,-||). (7) 

Note that an interconnection of subsystems of the form (5) can be unstable, i.e., not ISS, even if 
each of its subsystems is ISS. In the following subsection we recall known conditions that guarantee 
stability for interconnections of ISS systems. 



2.4. Known stability results for interconnected systems 

To establish ISS of an interconnected system of the form (3) we collect the gains 7^ 6 £00 U {0} 
of the ISS conditions (6) in a matrix V — (ji^nxn, with the convention 7^ = 0, i = 1, . . . , n. The 
operator T : R™ — > R™ is then defined by 

' max{7i i2 (s 2 ), . • . ,7i,n(s„)} ' 
r(s):= : . (8) 

y max{7„i(si),...,7 n , n _i(s n _i)} J 

In [12] the following theorem was proved that establishes ISS of interconnected system (3). 

Theorem 2.4 (Small gain theorem) 

Assume that each subsystem (5) is ISS. If condition 

r( s )^,v s eK;\{o} (9) 

holds, then (3) is ISS. 

The condition T(s) ^ s is called small gain condition. 

A Lyapunov type counterpart of the small gain theorem was proved in [11]. To recall this result 
we need first the following notion of an fi-path, see [11]. 

Definition 2.5 (£!-pafh) 

A continuous path a e IC^ is called an f2-path with respect to T if 

1. for each i, the function a^ 1 is locally Lipschitz continuous on (0, 00); 

2. for every compact set P c (0, 00) there are finite constants < c < C such that for all points 
of differentiability of a^ 1 and i = 1, , , . , n we have 

< c < (err 1 )'^) < C, VreP (10) 

3. for all r > it holds that 

I>(r)) < a(r). (11) 

Remark 2.6 

In [23, Proposition 2.7] and [26, Proposition 2.3.14] it was shown that if the small gain condition 
r(s) 2; s, Vs e R"\{0} holds, then fi-path can be constructed as a(t) := Q(at) for some vector 
a> and Q(s) := (Qi{s), . . . , Q n {s)) T , where Q^s) := m&x{s u (T(«))i, . . . , (P 1 " 1 ^))*}. 
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Theorem 2. 7 (Small gain theorem (in terms of Lyapunov functions)) 

Assume that each subsystem of (5) has an ISS Lyapunov function Vi and the corresponding gain 
operator T is given by (8). If T(s) 2; s for all s ^ 0, s > is satisfied, then the system (3) is ISS and 
an ISS Lyapunov function is given by 

V{x)= max (TT\Vi(xi)), (12) 

i— l,...,n 

where a e JC^ is an arbitrary O-path with respect to V. 



Consider an interconnected system of the form (3). Assume, for convenience that all its 
subsystems are ISS with gains 7^ collected in the gain matrix T. Then, to establish ISS of the 
interconnection we can use Theorem 2.4, i.e. we need to verify the small gain condition (9). By [33, 
Lemma 2.3.14] the small gain condition (9) is equivalent to the cycle condition 

7feife 2 °7fe2fe 3 ' ' ' °lk r -xk T < id, (13) 

for all (fci, k r ) e {1, n} r with k\ = k r . The largest possible number of cycles to be checked 
in this condition can be calculated as 2~2k=2 KM where is the binomial coefficient. 
Thus, too many scalar inequalities need to be verified on M + in case of large n. 



3. REDUCTION RULES 

To reduce the size of the gain matrix in the small gain condition (9) we model the structure 
of the network described in (3) as a directed graph with weights G — (V,£,T). The vertex set 
V = {1, . . . , n} corresponds to the subsystems of the network, the edge set £ to the interconnection 
between subsystems, i.e. 

y l 0, otherwise. ^ 

The weight of the edge from vertex i to j is given by 7^ and describes the influence of subsystem 
i on subsystem j. All the weights are collected in the gain matrix T. Note that the matrix T is not 
static, i.e. the weights are in general nonlinear functions. 

In our reduction approach we propose to reduce the size of the gain matrix T in the small gain 
condition (9). In particular, we transform the graph G = (V, £ , T) by introducing aggregation rules 
for vertices for typical subgraphs occurring in the network. Such subgraphs we will call motifs [30]. 
By aggregation of the vertices we understand the construction of a smaller graph G = (V, £, t) in 
which the vertices may represent nonempty subsets of vertices in the original graph G = (V, £ , T). 
We single out the following motifs: parallel connections, sequential connections of vertices and 
almost disconnected subgraphs. These reduction rules are inspired by the properties of motifs in 
[1]. 
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3.1. Aggregation of sequentially connected nodes 

The vertices of the set Vj = {v\, are called sequentially connected, see Figure 1, if there 

exist vertices v, v' e V \ Vj such that 



P(Vi) 



v i = 1, 

Vi-i i = 2, k 



and 



i = l,...,fc-l, 
v 1 i = l. 



S(vi) 

The predecessor set P and successor set S were defined in (2) and (1). 



0.r ^^^^ ^^^^ ^^^LlV ,v, 







v' 



Figure 1. Sequential connection of vertices vi, . . . , v^. 



The corresponding gain matrix is given by 

/ 



j VltV 

JV2.V! 



r = 



V 



o o 














Jvh.VI-! 

lv',v k ■ ■ ■ 





(15) 



/ 



The cycle condition (13) for the cycles that include nodes from {v\, . . . , v^} looks as follows: 

< id. (16) 



3.1.1. Aggregation of gains 

To obtain a graph of a smaller size we aggregate the nodes v\,...,v^ with the node v. We denote 
the new vertex by J. A cut-out of the new reduced graph is shown in Figure 2. So, we consider the 
reduced graph G = (V, E, V), where the vertices are given by 

V = (V\ (Vj U {v})) U J (17) 
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and the edges are given by 

£ = £ \ ({(v,w), (w,v'), (wi,w 2 ) : w,w 1 ,w 2 € V./} U (v,v')) 

U {(J, v') U (u, J) : (u, «)€£}. (18) 

The corresponding weighted adjacency matrix T of the dimension n — k can be obtained from T, 
where the rows and columns corresponding to the vertices v, v\, . . . , vt are replaced by a row and a 
column corresponding to the new vertex J. The weights are then given by 

7„/,j := max{7„/ il , fc o • • • o 

}, (19) 

Ij.v' ■= Hv,v<, Ij.j ■= Jv,j, Ij.j ■= j G V\ (Vj U {v,v'}). (20) 




Figure 2. Vertices v±, ...,«/.,«' are aggregated. 
Other gains stay the same, i.e. 

7y -=7ij,i,j J- (21) 

The small gain condition (9) corresponding to the reduced gain matrix T has the following 
properties. 

Theorem 3.1 

Consider a gain matrix T as in (15) where the nodes {vi, . . . , Vk} of the corresponding graph are 
sequentially connected. Then condition (9) holds for the matrix T if and only if condition (9) holds 
for aggregated the matrix T with gains defined in (19)-(21). 

Assume that there were p cycles that include one of the nodes Vi from Vj. If .v ^ 0, then the 
number of cycles to be checked in the cycle condition (13) corresponding to the reduced matrix f 
is decreased by p after the aggregation, otherwise it stays the same. 

Proof 

Let condition (9) for the gains defined in ( 1 9)-(2 1 ) hold. Then the cycle condition (13) corresponding 
to these gains holds. In particular, for the cycles containing the gain j v >j the following inequality 
holds: 

■ • • °7u',J ° ■ • • < id- (22) 

From the definition of the gain 7V ,j in (19) condition (16) holds. Condition (13) on other cycles 
corresponding to T is satisfied straightforwardly. Thus, the matrix T satisfies (9). 

For the proof in the opposite direction we consider the cycle condition (16) and from (19) 
obtain (22), i.e. cycle condition for the aggregated gain j v >j. The rest cycle conditions are satisfied 
straightforwardly. Thus, the matrix T satisfies (9). 
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If j v , j = 0, then, as the cycle containing one of the nodes {vi, . . . , contains necessarily all 
other nodes from {vi, ...,Vk}, the number of cycles to be checked in the cycle condition is the 
same. Otherwise, these cycles will "coincide" with the cycles that include gain j v >^ v . Thus, the 
overall number of the cycles will decrease by p. □ 

Thus, to show that a system of the form (3) is ISS, it is enough to verify the small gain condition 
T(s) ^ s corresponding to the reduced gain matrix T. 

Corollary 3.2 

Consider interconnected system (3) and assume that all the subsystems in (5) are ISS with gains as 
in (6). If condition (9) holds for the gains defined in (19)-(21), then the system (3) is ISS. 

Proof 

The assertion follows from Theorem 3. 1 and Theorem 2.4. □ 
3.1.2. Construction of an fl-path 

To construct an ISS-Lyapunov function of the interconnected system (3), we can apply Theorem 2.7. 
However, for this purpose we need to have an £!-path a satisfying (11), i.e. 

r(cr) < a. 

It appears, that if an £!-path corresponding to the reduced gain matrix T is known, we can calculate 
an £!-path for the large gain matrix V. Furthermore, we can additionally show that knowing an 
fi-path for large gain matrix V we can construct an Sl-path for the small gain matrix T 

Proposition 3.3 

Consider a gain matrix V and the corresponding reduced gain matrix T with gains defined in (19)- 
(21). Then: 

(i) If an fi-path a for T satisfying (11) is given, then an Sl-path a for the matrix T can be 
constructed as 

J 7« i ,»,.i 7»,-i.« i -2 '" 7»2fl T>i,» ^> ifw = Vi,ie{l,...,k}, 
o w ■= < _ " , (23) 

I a w , otherwise ; 

(ii) If an fi-path a for T satisfying (11) is given, then an fi-path a for the matrix T can be 
constructed as 

J a w if we V\ J, 
°w ■= < _ (24) 
I cr v , if w — J ; 

Proof 
Proof of (i): 

We assume that an £!-path a for the small gain matrix T is known. In particular, by (1 1) T(a) < a 
holds. Let us check whether fi-path a defined in (23) is an Sl-path for the large gain matrix T. To 
this end we need to check (1 1) for a. 
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For the components T(a) w , w $ {v%, . . . ,Vk,v'} the inequality (11) holds straightforwardly. 
Consider now T(a) w , w = Vi,i e {1, . . . , k}. Applying (19)-(21) and (23) we obtain: 

— 7u<,i>i-i ° &Vi-i = 7t)i,t>i-i ° 7t)i-i,«i_a ° <^»-2 

= • • • = 7«,,f,-i ° ' ' ' ° 7«i,ti ° 

= & Vi ) 

(?»)} 

^ y 
V 

TV,./ ?.; 

= max{7^,i(CTi), . . . ,7„',j .,j V ',n(<7n) 



Thus r(cr) < ct and ct is an fi-path corresponding to the large gain matrix F. 
Proof of (ii): 

Assume now that an f2-path a for the large gain matrix T is known. Let us check whether fi-path a 
defined in (24) is an £!-path for the small gain matrix T. To this end we need to check (1 1) for <r. 

For the components T(a) w , w ^ v' the inequality (11) holds straightforwardly. Consider now 
t{a) v i. Applying (19), (24) and (11) for w ^ v' we obtain: 

f(a) v > = max{7„' 4 o a u . . . ,j vl>J o aj, . . . ,j v >, n ° cr n } 
= max{7„/ 4 o o-i, ... , max{~f v t jVk o ■ ■ • o 

° <?■„} 

< max{7„/ : i o cti, . . . ,7„',« fc ° • • • o 7 V2 , Vl o a-^av, . . . ,7V,n ° o- n } 

< max{7„/ j i o cti, . . . ,7«',„ fc o CT Ufc ,CT /, . . . ,7V,n 5n} 

< max{7„/ j i o ^1, . . . , a v > , a v >, . . . , 7„',„ o ct„} 

< ct^, = a v i 

Thus r(cr) < a and <r is an fi-path corresponding to the small gain matrix T. □ 



The proposition above implies the following result concerning the construction of an ISS- 
Lyapunov function. 

Corollary 3.4 

Consider a system of the form (3) that is interconnection of subsystems (5). Assume that each 
subsystem i of (5) has an ISS-Lyapunov function Vi with the corresponding ISS-Lyapunov gains 
7ijj 7«i h j — 1, . • • ,nas in (7). If (9) holds for T defined by (19)-(21). Then the system (3) is has an 
ISS-Lyapunov function and an ISS-Lyapunov function is given by (12) with a from (23). 



Proof 

The assertion follows from Theorem 2.7 and Proposition 3.3. □ 
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3.2. Aggregation of nodes connected in parallel 

Parallel connections are characterized by the vertices having the same predecessor and successor 
sets consisting of a single vertex. Let the vertices Vj := {v\, . . . , Vk} C V be connected in parallel, 
i.e. every vertex has only one ingoing and one outgoing edge and the ingoing edges originate from 
one vertex v £ V and also the outgoing edges end in solely one vertex v' e V, see Figure 3. To be 
precise, Vj = {i G V : P(i) = v, S(i) = v'}. 




7^1 ,v 



"fv k ,v 




'Yv' ,vi 



lv',v k 




Figure 3. Parallel connection of vertices vi, . . . ,v k . 



The corresponding gain matrix is given by 

/ 



... 










7„ 1)V 

7„ fc ,„ 

7«',«* 





(25) 



/ 



The cycle condition (13) for the cycles that include nodes from {vi, . . . , Vk} looks as follows: 

< id. (26) 



3.2.1. Aggregation of gains 

Based on this structure a possibility to attain a graph of a smaller size is to aggregate the vertices 
connected in parallel to a single vertex and to leave the structure of the remaining graph as it is. We 
denote the new vertex by J. A cut-out of the new reduced graph is shown in Figure 4. 
So, we consider the reduced graph G = (V, £ , T), where the vertices are given by 

V = (V\(VjUW))UJ (27) 
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Figure 4. Aggregation of vertices vi, v. 

and the edges are given by 

£ = £ \ ({(v, w), (w, v'):we V,/} U (v, v')) U (J, v') U {(u, J) : (u, v) e £}. (28) 

The corresponding weighted adjacency matrix T of the dimension n — k can be obtained from T, 
where the rows and columns corresponding to the vertices v, vi, . . . , are replaced by a row and 
column corresponding to the new vertex J. The weights are then given by 

h (29) 

1j,v ■= 7v,v>, Jj,j~7v,j, 7j,j~lj,J, j eV\(VjU{v,v'}). (30) 
Other gains stay the same, i.e. 

The small gain condition (9) corresponding to the reduced gain matrix T has the following 
properties. 

Theorem 3.5 

Consider a gain matrix T as in (25) where the nodes {vi, . . . , Vk} of the corresponding graph are 
connected in parallel. Then condition (9) holds for the matrix T if and only if condition (9) holds 
for aggregated the matrix T with gains defined in (29)-(31). 

Furthermore, if there were p cycles that include node Uj, then the number of cycles to be checked 
in the cycle condition (13) corresponding to the reduced matrix T is decreased by p{k — 5 v > iV ), 
where S v \ v := 0, if j v < tV ^ and 5 V \ V := 1 otherwise. 

Proof 

Let condition (9) for the gains defined in (29)-(31) hold. Then the cycle condition (13) for these 
gains holds. In particular, for the cycles containing the gain 7„',j the following inequality holds: 

...°iyo.., <id. (32) 

From the definition of the gain 7^,7 in (29), condition (26) holds. Condition (13) on the other cycles 
is satisfied straightforwardly. Thus T satisfies (9). 
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For the proof in the opposite direction we consider the cycle condition (26) and from (29) 
obtain (32), i.e. cycle condition for the aggregated gain j v >j. The rest cycle conditions are satisfied 
straightforwardly. Thus, the matrix T satisfies (9). 

If there were p cycles that include node Vi in the large graph, then the number of the cycles 
that include a node from {vi, . . . , «&} is p ■ k. If j v / >v ^ 0, then the number of cycles with nodes 
{v\, . . . , Ufc} and gain j v * tV is p ■ (k + 1). After the aggregation of the gains these cycles will 
"coincide", thus the number of the cycles to be checked in the small gain condition (9) is decreased 
by p(k - 8 V > >V ). □ 



Again, to show that a system of the form (3) is ISS, it is enough to verify the small gain condition 
corresponding to the reduced gain matrix. 

Corollary 3.6 

Consider interconnected system (3) and assume that all subsystems in (5) are ISS with gains as in 
(6). If condition (9) holds for the gains defined in (29)-(31), then the system (3) is ISS. 



Proof 

The assertion follows from Theorem 3.5 and Theorem 2.4. □ 



3.2.2. Construction of an Vl-path 

Again we can calculate an Sl-path for a large gain matrix having an Sl-path corresponding for the 
reduced one and in opposite direction. 

Proposition 3. 7 

Consider a gain matrix V and the corresponding reduced gain matrix T with gains defined in (29)- 
(31). Then: 

(i) If an fi-path a for T satisfying ( 1 1 ) is given, then an fi-path a for the matrix T can be constructed 

as 

J T»,»°?J, ifwe{vi,...,v k ], .... 
<J W ■= < „ , (33) 

I a w , otherwise . 

(ii) If an fi-path a for T satisfying (11) is given, then an fi-path a for the matrix T can be 
constructed as 

( a w if we V\ J, 
°w ■= < _ (34) 
a v , it w = J ; 



Proof 
Proof of (i): 

We assume that an f2-path a for the small gain matrix a is known. In particular, by (1 1) T(a) < a 
holds. Let us check whether an fi-path a defined in (33) is an fi-path for the large matrix T. To this 
end we need to check (11). 
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For the components T(a) w , w $ {v%, . . . ,Vk,v'} the inequality (11) holds straightforwardly. 
Consider now T(a) w , w € {v±, . . . , Vk}- Applying (29)-(31) and (33) we obtain: 

r(a-)to = jw, v o a v = a w ; 

r(a) v > = max{7„' . . . ,j v > tVl (a Vl ), . . . , j v > tVl (a Vk ), . . . ,~f v >, n {a n )} 

= max{7„ v (5i), . . . , 7 t ,'.„ 1 o7„ 1 .^o5 : j, . . . , ^ v > , Vk o~f Vk ^ v oaj, . . . , j v >, n (a n )} 
v v — ' 

= max{7„^i(ai), . . . ,7„/,j oaj,.. ,„(?„) 
< OV = ctv. 

Thus T(ct) < <r and a is an fi-path corresponding to the large gain matrix T. 
Proof of (ii): 

Assume now that an Sl-path a for the large gain matrix T is known. Let us check whether £l-path a 
defined in (34) is an £!-path for the small gain matrix T. To this end we need to check (1 1) for <r. 

For the components T(a) w , w ^ v' the inequality (11) holds straightforwardly. Consider now 
t(a) vf . Applying (29), (34) and (1 1) for w ^ v' we obtain: 

f(a) v > = max{%' i ioax,...,j v ' i joaj,..., ; Y V ' tn oa n } 
= max{7 t) ^i oof-!,..., max{7 1 ,/ jt , 1 o 

< max{7 1 ,/ i i o ai, . . . ,7„/ )Wl o a Vl7 . . . ,j v ',v k oj,,,^,.- ,7i/,« ° ^n} 

< max{7 1 ,. i i o a-!,.. .,a v >,.. .,j v >, n ° ovj 

< a v > = a V ' 

Thus r(o-) < a and <r is an fi-path corresponding to the small gain matrix T. □ 
Corollary 3.8 

Consider a system of the form (3) that is an interconnection of the subsystems (5). Assume that 
each subsystem i of (5) has an ISS Lyapunov function Vi with corresponding ISS-Lyapunov gains 
— 1, • • • ,n as in (7). if (9) holds for T defined by (29)-(31), then the system (3) is has an 
ISS-Lyapunov function and an ISS-Lyapunov function is given by (12) with a from (33). 

Proof 

The assertion follows from Theorem 2.7 and Proposition 3.7. □ 



3.3. Aggregation of almost disconnected subgraphs 

A further structure in the network, that suggests itself to a reduction is given by subgraphs which 
are connected to the remainder of the network through just a single vertex. So, we consider a 
set of vertices Vj = {vi, ...,Vk} and a distinguished vertex u*eV \ Vj such that any path from 
Vi, i = 1, . . . , I to the remainder of the vertices in V \ Vj, and any path from V \ Vj to Vj necessarily 
passes through the vertex v* . If we assume that the whole graph is strongly connected, this implies 
in particular, that the subgraph induced by Vj U {v*} is by itself strongly connected. 

In Figure 5 an example graph is shown, where the vertices Vj = {vi, . . . , Vk} are connected with 
the rest of the graph only through the vertex v*. 
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Figure 5. The subgraph consisting of the vertices Vj = {v\, V2, 1*3} is almost disconnected from the graph. 

The cycles in (13) that include nodes only from {v\, v*} look as follows: 

7fei,fc 2 ° lk 2 ,k 3 o • • • o jk r -uk r < id, (35) 
for all (fci, k r ) e {vi, Vk, v*} r with ki = k r . 

3.3.1. Aggregation of gains 

To reduce the network size we aggregate the vertices of the subgraph Vj with vertex v* and do not 
change the remainder of the graph. We denote the new vertex by J. For the example in Figure 5 the 
reduced graph is shown in Figure 6. So we consider the reduced graph G = (V, £ , A), where the 
vertices are given by 

V = (V \ (VjU {«*})) U J (36) 

and the edges are given by 

£ = £ \ {(wi,w 2 ), (v*,wi), (wx,v*) : wi,w 2 € V./} 

u {(J,u) ■. u e V, (v*,u) e £} 

U {(«, J) : u e V, («,«*) e f}. (37) 




Figure 6. Subgraph Vj and node v* are merged to vertex J. 
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The corresponding weighted adjacency matrix f of the dimension n — k + 1 can be obtained 
from T, where the rows and columns corresponding to the vertices v%, . . . , Vk are replaced by a row 
and column corresponding to new vertex J. The weights are then given by 



U.v* ■= , s max {-fki,k a °7fe 2 ,fe 3 ° ' ' ' °lk r -i,k r }, (38) 

[k\ ,. . . ,k r )£ {v± , . . . ,Vk ,v* } r ,k± = k r 



Other gains stay the same, i.e. 



7 fv,j=id- (39) 



Jij ■■= Ty, i,j ^ J- (40) 



Theorem 3.9 

Consider a gain matrix T where the subgraph {v\, . . . , Vk} of the corresponding graph is strongly 
connected connected and connected to the remainder of the graph only through one node. Then 
condition (9) holds for the matrix T if and only if condition (9) holds for aggregated the matrix T 
with gains defined in (38)-(40). 

If there were p cycles that include nodes only from Vj U {«*}, then the number of cycles to be 
checked in the cycle condition (13) corresponding to the reduced matrix T is decreased by p — 1. 

Proof 

Let condition (9) for the gains defined in (38)-(40) hold. Then the cycle condition (13) for these 
gains holds. In particular, for the cycles containing 7„»,j, ^j, v * the following inequality holds: 

lv*,,j °l,j,v < id. (41) 

From the definition of the gains 7j jtl » and ^ v -j in (38) and (39), condition (9) for the large matrix 
T holds. Conditions on the other cycles in (13) are satisfied straightforwardly. 

For the proof in the opposite direction we consider the cycle condition (35) and from (38) and (39) 
we obtain (41), i.e. cycle condition for the aggregated gains j V ',j, Ij.v- The rest cycle conditions 
are satisfied straightforwardly. Thus, the matrix T satisfies (9). 

As instead of p cycles with nodes only from Vj U {v*} we consider only one cycle 7„*,j o jj lV *, 
the number of cycles corresponding to the small gain matrix T is decreased by p — 1. □ 

Corollary 3.10 

Consider interconnected system (3) and assume that all subsystems in (5) are ISS with gains as in 
(6). If condition (9) holds for the gains defined in (38)-(40), then the system (3) is ISS. 

Proof 

The assertion follows from Theorem 3.9 and Theorem 2.4. □ 
3.3.2. Construction of an fl-path 

Again, we can calculate an fi-path for a large gain matrix having an £!-path corresponding for a 
reduced one. 
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Proposition 3.11 

Consider a gain matrix T and the corresponding reduced gain matrix T with gains defined in (38)- 
(40). 

(i) If an fi-path a for T satisfying (11) is given, then an fi-path a for the matrix T can be 
constructed as: 

I ifwe{vi,...,v k }, 
(T w ■= S ~ , . (42) 

a w , otherwise , 



where 



7t«,J : = , N r max , , h™,^ °lv kl ,v k2 o . ..07 j}, (43) 

(k U ...,k r )£{v 1 ,...,V k }r,k i ^k j 112 



i.e. the maximum over compositions of minimal paths (all nodes are different) from node w to node 
J. 

(ii) If an O-path a for T satisfying (11) is given, then an fi-path a for the matrix T can be 
constructed as 

^eV\J, (44) 
I (T v * , if w = J: 

Proof 



Proof of (ii): 

We assume that an f2-path a for the small gain matrix a is known. In particular, by (1 1) T(a) < a 
holds. Let us check whether an fi-path a defined in (42) is an fi-path for the large matrix T. To this 
end we need to check (11). 

For the components T(a) w , w £ {vi, . . . the inequality (11) holds straightforwardly. 
Consider now T(a) w , w € {t>i, . . . , From Theorem (3.9) the cycle condition (13) holds for 
all Vi, . . . , Vk. Then applying (13), (42) and (43) we obtain 

T(a) w = max{7 o cr kl , . . . ,J WjVkr o a kr } 

= max{7„,„ ti o % kiJ o a j, . . .,J W}Vkr ° % kr j ° 5 
= %,j ° <?j 

= &w 

Thus (11) holds for any we . . . , v k } and thus a is an 17-path corresponding to the large gain 
matrix T. 
Proof of (ii): 

Assume now that an Sl-path a for the large gain matrix T is known. Let us check whether £!-path a 
defined in (44) is an £!-path for the small gain matrix T. To this end we need to check (1 1) for a. 

For the components T(a) w , w £ {v*,J} the inequality (11) holds straightforwardly. Consider 
now f(cr) . and t(a)j . Applying (13), (38), (44) and (11) we obtain: 

t(a) v * = max{7„. a o Si, . . . , 7 „»,j o aj, . . . ,%>, n ° a n } 

= max{7 1 , % i o ax, . . . , aj, . . . , %r >n o a n } 

= max{7 t , % i o cti, . . . . . . ,tv,„ o a n } 

< 5L. 



Copyright © 2010 John Wiley & Sons, Ltd. 
Prepared using rncauth.cls 



Int. J. Robust. Nonlinear Control (2010) 
DOI: 10.1002/rnc 



REDUCTION OF THE SMALL GAIN CONDITION FOR LARGE-SCALE INTERCONNECTIONS 



19 



and 

f {pi) J = l.J.v* ° &v* 

= max {7*i ,*a °lk 2 ,k s ° ■■■ °7fcr-i,fer} &v 

< cr„. 

= 

Thus r(cr) < a and a is an fi-path corresponding to the small gain matrix V. □ 
Corollary 3.12 

Consider a system of the form (3) that is an interconnection of the subsystems (5). Assume that 
each subsystem i of (5) has an ISS-Lyapunov function V* with the corresponding ISS-Lyapunov 
gains = 1, • • • ,n as in (7). If (9) holds for a defined by (38)-(40), then the system (3) has 

an ISS-Lyapunov function and an ISS-Lyapunov function is given by (12) with a from (42). 

Proof 

The assertion follows from Theorem 2.7 and Proposition 3.11. □ 



4. APPLICATION OF AGGREGATION RULES 

The properties of aggregation rules can be summarized in the following corollary. 
Corollary 4.1 

Consider interconnected system (3) and assume that all subsystems in (5) are ISS with gains as 
in (6). Let gain matrix T is obtained by step-by-step application of aggregation rules for parallel, 
sequential and almost disconnected subgraph in any order. If condition (9) holds for matrix L, then 
the system (3) is ISS. 

Proof 

The proof follows from Corollary 3.2, Corollary 3.6, and Corollary 3.10. □ 

Let us apply the obtained reduction rules on the following example with the network 
of 30 nodes, see Figure 7. We assume that all the subsystems are ISS with the following 
gains 7^: 73,1 (*) = ft 2 , 7i,2(0 = 2t, 7243(0 = \\fU 7i3,3o(0 = *, 730,29 (*) = At 2 , 
729,2s(i) = Vi, 729,23(0 = jot 2 , 72347(0 = v 7 *, 71742(0 = 3t, 712,7(0 = t 2 , 774(0 = 

734(0 = V*> 74,3(0 = t t2 , 74,6 (*) = *, 76,3(0 = Vt, 715,11 (*) = t 2 , 711,16(0 = |*. 716,11 (*) = *, 
716,15(0 = V*. 715,16(0 =t 2 , 719,15(0 = Vt, 720,15(0 = 2a/*, 726,19,(0 = 3*' 726,20 (0 = H 
722,26(0 = \t 2 , 721,22(0 = 2 Vt, 722,2l(0 = \t 2 , 716,22(0 = 3 V*. 75,3(0 = |0714,8(0 = 
|* 2 , 78,5(0 = V~t, 714,9(0 = I* 2 , 79,5(0 = 2^,714,10(0 = t 2 , 710,5(0 = |^,728,27(0 = 
\t 2 , 727,25(0 = V 7 *, 728,24(0 = 724,18(0 = t 2 , 725,18 = * 2 ,7l8,14(0 = 

To establish ISS of this network we can apply Theorem 2.4. To this end we need to verify small 
gain condition (9) or equivalent cycle condition (13). The network in Figure 7 has 29 minimal 
cycles, i.e. cycles with fcj ^ kj for i ^ j other than for ko = kj. Note that already at this stage it 
is rather difficult to identify all the minimal cycles. To this end we can use a numerical algorithm, 
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Figure 8. Subgraph. 



Figure 7. Network of 30 nodes 

see for example [22] and [41]. However, finally we will need any way to verify the cycle conditions 
analytically. To apply Theorem 2.4 we need to check 29 cycle conditions. 
The longest minimal cycle consists of 14 nodes. 

Consider the sub-graph with nodes 3, 5, 8, 9, 10, 14, 18, 24, 25, 27 and 28, see Figure 8. 
This subgraph can be aggregated in several steps: 

1. Aggregation of nodes connected in parallel: 

7i4,5 = max{7i4 !8 o 73,5,714,9 ° 79,5,714,10 710,5} 



Thus we obtain the graph with 21 nodes, see Figure 9. 

Let us apply aggregation rules to the rest of the graph in the following order: 

1. aggregation of almost disconnected subgraph with nodes 1 1, 15-16, 19-22 and 26; 

2. aggregation of sequentially connected nodes 7, 12, 17, 23; 

3. aggregation of sequentially connected nodes 2, 13, 30 

Thus we obtain the graph with 7 nodes, see Figure 10. The gains of the aggregated network are as 
follows: 

728,3^) := if* 73,i(i) := ft 2 , 74,1(4) := t, 73,4(4) := ft 2 , 74,3(4) := y/i, % 3 (t) := V~t, 
74,e(4) := 4, %,u(t) := t, 7n, 6 (4) := §4, 73,28 (4) := §4, 729,28(4) := \ft, 71,29(4) := ft, 
729,4(4) := ^4. 

The reduced graph has now 8 minimal cycles, where the longest maximal cycle has 5 nodes. 
To establish ISS of the large network we can apply Corollary 4.1 . Thus we need to verify T(s) ^ s 
or equivalently the cycle condition (13) corresponding to reduced matrix T. 



= max{i(^(4)) 2 , if(2 x /(4)) 2 , (i^4)) 2 } = ft 



2. Aggregation of sequentially connected nodes: 

728,25 = 728,27 ° 727,25 = \{\f{t)) 2 = §4 

3. Aggregation of nodes connected in parallel: 



728,18 = rnax{72 8 ,24 ° 724,18,728,25 ° 725,18} = niax{i4 2 , \t 2 } = \t 2 
4. Aggregation of sequentially connected nodes: 



728,3 = 728,18 ° 718,14 ° 7l4,5 75,3 = j{J = if*' 
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Figure 9. Graph with 21 nodes. 

Figure 10. Graph with 7 nodes. 



The corresponding cycle condition looks as follows: 

73,4 ° 74,3 < id, 73,4 ° 74,6 ° 76,3 < id, 76,11 ° 711,6 < id, 728,3 73,28 < id, 74,1 71,29 729,4 < 

id, 74,3 73,i 71,29 729,4 < id, 73,1 ° 71,29 729,28 728,3 < id, 73,4 74,1 71,29 729,28 
728,3 < id. 

Let us verify it: 

73,4 ° 74,3(0 
73,4 ° 74,6 76,3 (*) 

76,11 711,6 W 
728,3 73,28 
74,1 71,29 729,4(0 
74,3 73,1 71,29 729,4(0 



73,1 7l, 29 729,28 ° 728,3(0 
73,4 ° 74,1 ° 71,29 ° 729,28 728,3(0 

Thus by Corollary 4. 1 the large network is ISS. 

Assume now that we know also ISS-Lyapunov functions Vi for all subsystems of the large 
network. Let us construct an ISS-Lyapunov function for the small network and the for the large 



(74, 3 (0) 2 



1(74,6 ° 76,3(0) 2 = 

= 711,6 (*) = f* 
= i§7S,28(*) = i* 
= 71,29 729,4(0 = 



± 

5 
4 

I(V0 



!(76, 3 (0) 2 



1 10 25 



\/73,l 71,29 729,4(0 
^§(71,29 729, 4 ) 2 = yf^t 
§ (71,29 ° 729,28 728,3((0) 2 
|(!729,28 O728, 3 (0) 2 = |(!' 



/ 13^2 
16 L ) 



K74 



5 V 



52 . 
125 



30 L 



< t 



< 
< 
< 
< 



< 
< 



< t; 
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network. Consider the following functions Oj : 



Let us check whether T(a) < a: 



7i7(oV(*)) 


- 2+ 


< 


t = 




max{72i (cti (*)) > 723 (^3 (t)), 726 (^6 (*)) } 


= max{it 2 , it 2 , ^ 2 } 


< 


t 2 = 


= 5 ? 2(*) 


max{73i(3 : i(t)),732(o : 2(0):734(CT4(i))} 


= max{i,t,i} 


< 


t = 


5 3 (*) 


max{742 (<r 2 (*) ) , 745 (£5 (i) ) } 


= max{t, t} 


< 


t = 




754 (^(t)) 


- 2+ 


< 


t = 


5=5 (t) 


762 (^(t)) 


3 f 2 
16 1 


< 


t 2 -- 


= £ 6 (t) 


max{773 (<r 3 (t) ) , 7 76 (<r 6 (t) ) } 


= max{i£,t} 


< 


t = 





Thus r(cr) < <t and cr such that r(cr) < cr can be constructed applying rules for sequentially 
connected nodes in (23), nodes connected in parallel in (33) and almost disconnected subgraphs in 
(42): 
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tri(t) = eri(t) 

O2(0 = 72,13 ° 713,30 ° 730,29 ° 5-29 (*) 

a 3 (t) = er 3 (t) 

CT 4 (t) = cr 4 (i) 

05 (0 = 75,3° 03 (£) 

1^6 (0 = 5-6 (0 

C7 (*) = 77,4° O4 (0 

os(0 = 78,5° 05 (i) 

Og(0 = 79,5° O5(0 
O-lo(t) = 710,5 °<?5 (0 

crn(t) = CTii (*) 

<T12^) = 712,7 

0"13(*) = 713,30 730,29 CT 2 9(t) 

0"14(*) = 714,5 0<7 5 (t) 

(Ti S (t) = max{7i 5) H , 715,16 0716,11} <ru(t) 

oie(0 = max{7i6,n, 716,15 715,11, 7i6 ,22 722,26 726,20, 

°720,15 715,11, 716,22 722,26 ° 726,19, °7l9,15 ° 7l5,ll} ° Cil(t) 
0-17(0 = 717,12 ° Ul2(t) 

ois(0 = 7i8,i4 <ru(t) 

(719 (t) = max{7i9 4 5 o 715,11,719,15 ° 715,16 716, 11} (711 (t) 
(720 (*) = max{720, 15 715,11,720,15 715,16 716, 11} CTlllO 

(721 (t) = max{721,22 722,26 726,20 720,15 715,11,721,22 722,26 726,19 719,15 715,11, 

721,22 722,26 726,20 720,15 715,16 716,11, 

721,22 722,26 726,19 719,15 715,16 7l6,ll} <7ll(t) 
CT22(0 = max {722,26 726,20 720,15 715,11,722,26 726,19 719,15 715,11, 

722,26 726,20 720,15 715,16 716,11, 

722,26 726,19 719,15 715,16 7l6,ll} Cll(0 
0-23 (*) = 723,17 0-l7(t) 

0-24(0 = 724,18 O CTi 8 (0 = ^t 2 

0-25(0 = 725,18 °Ol 8 (0 = ^t 2 

O2e(0 = max{726, 20 720,15 715,11,726,19 719,15 715,11, 
726,20 720,15 715,16 716,11, 

726,19 719,15 715,16 716, ll} O-n(0 = f* 

0-27(0 = 727,25 ° O25 (0 = J^t 

0-28 (0 = O- 28 (0 = t 2 

(729(0 = 0-29(0 = f ' 

0- 3 o(0 = 730,29 °O2g(0 = 4t 2 . 

Then an ISS-Lyapunov function for the large network can be constructed as V(x) = 

max a~ 1 (Vi (xt ) ) using Theorem 2.7. 

i= l,...,n 
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5. CONCLUSIONS 

The aggregation rules introduced in this paper preserve the main structure of a network and allow to 
reduce the number of computations during the verification of the small gain condition. Furthermore, 
in the case that there exist several motifs in one network, these rules can be applied step-by-step to 
reduce the size of the gain matrix T. The sequence of the application of these rules may be arbitrary 
or depend on some additional information about the network topology. For example, this sequence 
may depend on information about the most influential nodes of the network, see [39, Algorithm 1]. 

In this paper we have performed only initial steps in the development of a structure-preserving 
reduction approach for large-scale networks with nonlinear dynamics. The next steps are: extension 
of the aggregation rules to other types of motifs, introduction and estimation of the error measure 
that compares the reduced and the original models, and the development of a numerical algorithm 
that performs this reduction. Further improvement of the approach may be performed by adaptation 
of the ranking technique used in [37] , [38] and [39]. 
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